0 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




© Publication number: 



0 487 110 A2 



© 



© Application number: 91119983.4 
© Date of filing: 22.11.91 



EUROPEAN PATENT APPLICATION 

© int. ci.5:G06F 15/42 



© Priority: 22.11.90 JP 320498/90 

© Date of publication of application: 
27.05.92 Bulletin 92/22 

© Designated Contracting States: 
DENL 

© Applicant: Kabushiki Kaisha Toshiba 
72, Horikawa-cho Saiwai-ku 
Kawasaki-shi(JP) 

@ Inventor: Yamada, Shinichi, c/o Intellectual 
Property Div. 

Kabushiki Kaisha Toshiba, 1-1 Shibaura 
1-chome 

Minato-ku, Tokyo 105(JP) 



Inventor: Komatsu, Kenichi, c/o Intellectual 
Property Div. 

Kabushiki Kaisha Toshiba, 1-1 Shibaura 
1-chome 

Minato-ku, Tokyo 105(JP) 

Inventor: Ema, Takehiro, c/o Intellectual 

Property Div. 

Kabushiki Kaisha Toshiba, 1-1 Shibaura 
1 -chome 

Minato-ku, Tokyo 105(JP) 

© Representative: Blumbach Weser Bergen 
Kramer Zwirner Hoffmann Patentanwalte 
Radeckestrasse 43 
W-8000 Munchen 60(DE) 



® Computer-aided diagnosis system for medical use. 
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© A picture archiving communication system for 
storing, transferring various digital image data in a 
single or a plurality of hospitals includes a modality 
(10), a data base (12), a workstation (14) as a display 
unit, and a network (16) for connecting these compo- 
nents. The modality (10) includes various diagnosis 
apparatuses for generating medical digital images, 
such as a film digitizer (18), an angiography appara- 
tus (20), a CT scanner (22), an MRI system (24), a 
nuclear medicine diagnosis apparatus (26), an ul- 
trasound diagnosis apparatus (28), and an electric 
endoscope (30). An examination ordering system 
(32) is connected to the network (16). The work- 
station (14) outputs computer-aided diagnosis data 
obtained by analyzing medical image data by means 
of a computer. This computer-aided diagnosis data 
includes the location, the type, and the degree of 
abnormality. In order to alarm an abnormality, the 
workstation (14) displays a marker pointing the por- 
tion of the abnormal portion on the image, a text 
sentence representing the details of the abnormality. 
The computer-aided diagnosis data is obtained be- 
fore its output is requested. The computer-aided 
diagnosis data is stored in a semiconductor memory 



(86) until its output is requested. 
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The present invention relates to a computer- 
aided diagnosis system for medical use, which 
outputs computer-aided diagnosis data for medical 
images using a computer. 

Recently, a computer-aided diagnosis system 
(hereinafter referred to as a CAD system) for medi- 
cal use has been developed in which the features 
of medical image data are determined and 
computer-aided diagnosis data (hereinafter referred 
to as CAD data) for assisting a doctor are obtained 
by using a computer. It is, however, cumbersome 
for a doctor to operate a computer to obtain the 
CAD data during the diagnosis, resulting in an 
adverse effect on a reading operation of image in 
terms of both time and labor. Further, the conven- 
tional CAD system itself cannot provide a high 
precision CAD data required for the diagnosis. 

Examples of such CAD system are disclosed in 
USP 4,851,984 and USP 4,839,807. The CAD sys- 
tem described in the above USPs comprises 
means for inputting a medical image, means for 
analyzing the medical image using a predeter- 
mined CAD algorithm, and means for displaying an 
analysis result. 

The doctor refers to the output of the CAD 
system at the time of reading of the medical image 
to prevent an oversight of a shadow image of the 
abnormal portion. 

To obtain the CAD data, the following proceed- 
ings are required. Locations of one type of ab- 
normal shadow images, e.g., an abnormal shadow 
image of the interstitial lung disease, are detected 
on a conventional X-ray radiograph and the result 
of the detection is output. Therefore, the medical 
image on the X-ray film is digitized. A rib, an object 
of the analysis, is identified in the medical image. A 
region of interest (hereinafter referred to as a ROI) 
is set on the medical image, as described in the 
USP 4,851 ,984. The data in the ROI is frequency- 
analyzed to extract the amount of physical texture 
of the image. The shadow image is classified into 
groups based on the amount of physical texture. A 
display device displays the digital image and the 
type, degree, and position of the shadow image in 
an overlapping manner. 

The reading operation by the doctor is to draft 
the reading report. Before, drafting the report, the 
doctor refers to the CAD data to prevent an over- 
sight of a shadow image. 

If the doctor needs the CAD data, the above 
proceedings must be performed. That is, the medi- 
cal image must be digitized before the CAD sys- 
tem starts to operate. The digitized image is ana- 
lyzed by the computer using the above proceed- 
ings and the analysis result is output to an attached 
display device. The doctor continues the reading of 
the image after watching the CAD result. 

The above described CAD system has follow- 
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ing drawbacks. 

The same CAD algorithm which is included in 
the CAD system is applied to the image data 
regardless of the type of the image. For example, 

5 the same CAD algorithm is applied to a conven- 
tional X-ray radiograph of chest as well as a CT 
image. Therefore, an unexpected CAD result is 
obtained thus lowering the ability of diagnosis. 

The CAD system includes only one CAD al- 

w gorithm for a given disease. Therefore, it is not 
possible to obtain a plurality of CAD data for a 
plurality of diseases. Therefore, if ten diseases are 
to be detected from one image based on the CAD 
data, the image data must be input to ten CAD 

is systems and ten CAD data must be output. This 
increases the time and labor for the CAD operation. 

A time for merely reading the image without 
outputting the CAD data is about three minutes. A 
time from requesting a kind of CAD operation to 

20 output the CAD data is about two minutes. If the 
CAD operation is performed during the reading, it 
takes a long time for reading and a difficulty occurs 
for the reading. 

The CAD data includes many items, e.g., the 

25 position, type, and degree of the abnormality. In 
the conventional CAD system, ail the items of data 
are output, thereby the output becomes compli- 
cate. 

The CAD system does not store the CAD re- 
30 suit, therefore, if the CAD operation is requested 
for the image which has been once analyzed, the 
same CAD operation is repeated thus wasting the 
time. 

Meanwhile, a picture archiving communication 
35 system (hereinafter referred to as a PACS) for 
transferring, storing, and displaying the medical 
images has been developed. In the PACS, digital 
medical image data archived by modalities includ- 
ing a digitizer and attribute data thereof are trans- 
40 ferred via a network and are stored in a large 
capacity recording means such as an optical disk 
device. Desired data are retrieved by using a data 
base system. The image data is transferred to a 
workstation via the network and is displayed. How- 
45 ever, the prior PACS does not function a CAD 
operation. 

Accordingly, it is an object of the present in- 
vention to provide a computer-aided diagnosis sys- 
tem for medical use, which outputs computer-aided 

so diagnosis data with a high precision by a simple 
operation having no adverse effect on diagnosis 
made by doctors. 

Another object of the present invention is to 
provide a picture archiving communication system 

55 incorporating the computer-aided diagnosis system 
for medical use and having a high diagnosis preci- 
sion. 

According to one aspect of the present inven- 
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tion, there is provided a computer-aided diagnosis 
system comprising means for inputting a medical 
image and attribute data of the medical image, 
means for storing a plurality of computer-aided 
diagnosis algorithms, means for selecting, based 5 
on the attribute data, an optimum computer-aided 
diagnosis algorithm suitable for the medical image, 
means for analyzing the medical image using the 
optimum computer-aided diagnosis algorithm se- 
lected by said selecting means, and means for io 
displaying an analysis result of said analyzing 
means. 

This invention can be more fully understood 
from the following detailed description when taken 
in conjunction with the accompanying drawings, in 75 
which: 

Rg. 1 is a block diagram showing the arrange- 
ment of a first embodiment of a computer-aided 
diagnosis system for medical use according to 
the present invention; 20 
Rg. 2 shows items of examination data; 
Rg. 3 shows a practical example of the exami- 
nation data for a conventional X-ray radiograph 
of chest; 

Rg. 4 is a block diagram showing the arrange- 25 

ment of a film digitizer shown in Fig. 1 ; 

Rg. 5 shows items of relevant data; 

Rg. 6 shows a practical example of the relevant 

data; 

Rg. 7 is a view for defining an imaging direction 30 
in the conventional X-ray radiography; 
Rg. 8 is a block diagram showing the arrange- 
ment of a data base shown in Rg. 1; 
Rg. 9 shows an examination directory included 
in a data retrieving device shown in Rg. 8; 35 
Rg. 10 shows the relationship between a doctor 
ID and a requesting doctor ID which is used 
when the image is transferred to a workstation at 
the time of reading; 

Rg. 11 shows an operation for transferring the 40 
images which has been examined to the work- 
station at the time of reading; 
Rg. 12 is a block diagram showing the arrange- 
ment of the workstation shown in Rg. 1 ; 
Rg. 13 shows an example of the images dis- 45 
played on the workstation in the PACS at the 
time of diagnosis of the conventional X-ray 
radiograph; 

Rg. 14 shows a CRT image display control table 
for managing the display of the workstation; 50 
Rg. 15 shows a table registering the relationship 
between the name of a CAD algorithm and asso- 
ciated attribute data of the image which is ap- 
plied with the CAD algorithm; 

Rg. 16 is a view showing a practical example of 55 
ROI setting in lungs; 

Rg. 17 is a block diagram schematically show- 
ing an algorithm for automatically setting an 



110 A2 4 



ROI; 

Rg. 18 is a detailed block diagram for explaining 
the diagram of Rg. 16; 

Rg. 19 is a block diagram schematically show- 
ing an algorithm for obtaining the amount of 
textures in the ROI; 

Fig. 20 is a flow chart schematically showing an 
algorithm for determining based on the amount 
of textures whether the ROI is normal or ab- 
normal; 

Fig. 21 is a block diagram performing the opera- 
tion shown in Fig. 20; 

Fig. 22 shows an example of the data format of 
a CAD result; 

Fig. 23. is a view showing a practical example of 
the CAD result data; 

Fig. 24 is a perspective view showing a touch 
panel as an example of an input device of the 
workstation; 

Fig. 25 is a view showing a display example of 
the touch panel; 

Fig. 26 is a view for explaining an example of a 
schematic naming of abnormal positions; 
Fig. 27 shows a relationship between locations 
and coordinates of the abnormal positions; 
Fig. 28 shows a table for explaining an example 
of detailed naming of the abnormal positions; 
Fig. 29 shows an example of a text sentence 
display; 

Fig. 30 shows an example of marker display; 
Fig. 31 shows an example of detailed CAD dis- 
play using the marker shown in Fig. 30; 
Fig. 32 shows another example of the marker 
display; 

Fig. 33 shows an ROC curve display as an 
optional CAD output; 

Fig. 34 shows the data format of a CAD result; 
Fig. 35 shows a practical example of the CAD 
result; 

Fig. 36 is a block diagram showing the arrange- 
ment of a CAD processor included in a second 
embodiment of a computer-aided diagnosis sys- 
tem for medical use according to the present 
invention; 

Fig. 37 is a block diagram showing the arrange- 
ment of a sound output device as a main part of 
a third embodiment of the present invention; 
Figs. 38A and 38B show examples of a menu 
window display according to a seventh embodi- 
ment of the present invention; 
Fig. 39 is a block diagram showing the arrange- 
ment of a computer-aided diagnosis system ac- 
cording to an eleventh embodiment of the 
present invention; 

Figs. 40A to 40E show modifications of marker 
display according to a twelfth embodiment; 
Figs. 41 A to 41 F show other modifications of the 
marker display according to the twelfth embodi- 
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ment; 

Figs. 42A and 42B show still another modifica- 
tions of the marker display according to the 
twelfth embodiment; and 

Fig. 43 shows an example of a table formed of 
names of algorithms stored in a memory in a 
seventeenth embodiment of the present inven- 
tion. 

A preferred embodiment of a computer-aided 
diagnosis system for medical use according to the 
present invention will now be described with refer- 
ence to the accompanying drawings. Though it is 
possible to embody the CAD system as a stand- 
alone system, an embodiment of the CAD system 
incorporated into the PACS will be described. Fig. 
1 is a block diagram showing the first embodiment 
constructed on the basis of the PACS. In general, 
the PACS is a system for performing storage and 
transferring of various types of digital image data 
produced in a single or a plurality of hospitals, and 
is formed of an image data source 10 (hereinafter 
referred to as a modality), a data base 12, a 
workstation 14 as a display unit, and a network 16 
for connecting these components. 

The modality 10 includes various diagnosis de- 
vices for generating medical digital images, such 
as a film digitizer 18 for digitizing an image of an 
X-ray film obtained by an X-ray radiography ap- 
paratus, an angiography imaging apparatus 20, a 
computed tomography (CT) scanner 22, a mag- 
netic resonance imaging (MR!) system 24, a nu- 
clear medicine diagnosis apparatus 26, an ultra- 
sound diagnosis apparatus 28, and an electric en- 
doscope 30. 

An examination ordering system 32 is also 
connected to the network 16 via a gateway 34. The 
examination ordering system 32 supplies examina- 
tion data indicating details of examination on in- 
dividual patients to the network 16. In this manner, 
the PACS performs control of data on the basis of 
correspondence between image data obtained by 
examination by the modality 10 and attribute data 
(including examination data, relevant data, and 
amend and/or update data for these data supplied 
from the workstation 1 4 and the data base 1 2). It is 
noted that the number of each of the modalities 1 0, 
the data base 2, and the workstation 14 is not 
limited to that of the above arrangement but can be 
increased or decreased as needed. 

Fig. 2 shows an example of items of examina- 
tion data input by the examination ordering system 
32 and supplied to the network 16. An examination 
ID number is issued every time examination is 
performed. In the examination ordering system 32, 
such examination data is input by a doctor or a 
person in charge at the start of examination, and a 
technician of the modality executes examination on 
a patient upon receiving the examination request, 
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thus obtaining image data. Each frame of the im- 
age data is associated with the relevant data. An 
example of the relevant data is shown in Fig. 5. 
When, for example, radiographic examination 
5 using a conventional X-ray radiography apparatus 
is necessary, examination data as shown in Fig. 3 
is input from the examination ordering system 32. 
A radiographic technician of the conventional X-ray 
radiography apparatus (not shown) takes conven- 

10 tional X-ray radiographs according to the input ex- 
amination data. In the case of a conventional X-ray 
radiograph, digital image data can be obtained by 
digitizing the image of the X-ray film by the film 
digitizer 18. The image data, for example, consists 

75 of an array of data obtained by dividing the X-ray 
film into a matrix of 1,024 x 1,024 pixels and 
representing the density of each pixel by a digital 
number of 10-bit. 

Fig. 4 shows the arrangement of the film . 

20 digitizer 18. The film digitizer 18 comprises a con- 
troller 40, an input device 42, a display device 43, 
a read-only memory (ROM) 44, an 
examination/relevant data storing device 46, an im- 
age data storing device 48, a semiconductor mem- 

25 ory 50, a film density detector 52, a central pro- 
cessing unit (CPU) 54. and a network interface (l/F) 
56. Of these components, the controller 40, the 
input device 42, the display device 43, the ROM 
44, the examination/relevant data storing device 46, 

30 the image data storing device 48, the semiconduc- 
tor memory 50, the film density detector 52, the 
CPU 54, and the network l/F 56 are connected to a 
control bus line 58. The ROM 44, the image data 
storing device 48, the semiconductor memory 50, 

35 the film density detector 52, and the network l/F 56 
are connected to an image bus line 60. The net- 
work l/F 56 is connected to the network 16. 

The film density detector 52 divides an X-ray 
radiograph into a matrix of 1,024 x 1,024 pixels. 

40 The density detector 52 scans each pixel with a 
laser beam and measures the intensity of transmit- 
ted light to obtain the density of the pixel, thereby 
forming an intensity distribution of the transmitted 
light of the X-ray radiograph. This intensity distribu- 

45 tion is converted into digital intensity data, and the 
data is supplied to the data storing device 48 
through the image bus 60 and is stored therein as 
the image data. At the same time, examination 
data, together with relevant data, is stored in the 

so examination/relevant data storing device 46. At this 
time, the display device 43 displays a prompt 
message for urging a technician to input an imag- 
ing direction of radiograph if the imaging direction 
is not input. When the text character denoting the 

55 imaging direction is input from the input device 42 
such as a keyboard, this data is written in the 
column of the imaging direction of relevant data 
(Fig. 5) stored in the storing device 46. 

4 
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Fig. 6 shows a practical example of the rel- 
evant data. The imaging direction of radiograph is 
defined, as shown in Fig. 7, such that when X-rays 
radiated from the back of a patient are detected on 
an X-ray film placed in front of the patient, the 
resulting image is referred to as a front image. 
Similarly, a right-side (left-side) image is defined as 
an image obtained when X-rays radiated from the 
left (right) side of the patient are detected on a X- 
ray film placed on the right (left) side of the patient. 
When digitizing of one frame of the X-ray radiog- 
raph is completed, the image data and the cor- 
responding relevant data are associated with each 
other by means of the image ID number. The 
examination data and the corresponding relevant 
data are associated with each other by means of 
the examination ID number. The image data, the 
corresponding examination data, and the corre- 
sponding relevant data are supplied to the network 
16 via the network l/F 56 and transferred to the 
data base 12 or the workstation 14 as data flowing 
through the network 16. 

Fig. 8 shows the arrangement of the data base 
12. The data base 12 comprises a CPU 62. a ROM 
64, a semiconductor memory 66, a controller 68, a 
data retrieving device (including an examination 
directory) 70, a data compression circuit 71, an 
image data storing device 72, and a network inter- 
face (l/F) 74. Of these components, the CPU 62, 
the ROM 64, the semiconductor memory 66, the 
controller 68, the data retrieving device 70, the data 
compression circuit 71, the image data storing de- 
vice 72, and the network l/F 74 are connected to a 
control bus line 76. The ROM 64, the semiconduc- 
tor memory 66, the data compression circuit 71, 
the image data storing device 72, and the network 
l/F 74 are connected to an image bus line 78. The 
network l/F 74 is connected to the network 16. 

The image data, the corresponding examina- 
tion data, and the corresponding relevant data, 
which are flowing through the network 16, are input 
to the data base 12 via the network l/F 74, and 
stored in the image data storing device 72. If 
necessary, these data, particularly the image data 
is temporarily stored in the semiconductor memory 
66 as a buffer memory. In this case, after the 
amount of the data is compressed to 1/2 or 1/10 by 
the data compression circuit 71 , the data is stored 
in the image data storing device 72. The examina- 
tion data and the relevant data are registered in the 
examination directory of the data retrieving device 
70 to retrieve desired examination data and rel- 
evant data using an examination ID and read out 
items of data. 

Fig. 9 shows an example of data contained in 
the examination directory of the data retrieving 
device 70 of the data base 12. Referring to Fig. 9, 
reference symbol N denotes the number of images 
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obtained in one examination. The examination di- 
rectory is formed of examination data (Fig. 2), 
address data for storing the reading report, amount 
of data of the reading report, and N number of 

5 image data included in the examination. Each of 
the image data is formed of address data for stor- 
ing the relevant data, amount of data of the rel- 
evant data, address data for storing the image data, 
amount of image data, and first CAD result to n-th 

70 CAD result. The CAD result is formed of a CAD ID 
number and address data for storing the CAD 
result. 

Next, an image reading operation performed by 
a doctor for the digital images whose attribute data 

is are stored in the data base 12 as described above 
will be described. In hospitals, the image reading is 
performed to obtain a diagnosis result from medi- 
cal images. The image reading in the PACS is that 
images are displayed on a display device such as 

20 a CRT of the workstation 1 4 and a doctor makes a 
diagnosis from the displayed images or X-ray film 
obtained in the conventional X-ray radiography ex- 
amination. 

When a doctor for image reading inputs his or 

25 her ID number with the power source of the work- 
station 14 ON, the workstation 14 is set ready for 
receiving an image reading request. This is the 
' same procedure as the log in operation in the 
conventional computer system. At this time, the 

30 workstation 14 sends a transfer request for images 
of a patient as an object to be image-read to the 
data base 12 on the basis of the examination ID 
input by the doctor or the examination ID which is 
registered in association with the doctor ID as 

35 shown in Fig. 10. If the patient has been examined, 
the workstation 1 4 may send a transfer request for 
images which have been read or viewed but are 
necessary to be referred as well as images which 
is not read or viewed. The necessary images are 

40 retrieved by means of, for example, the data base 
12. All the examination IDs relating to the patient ID 
and the necessary image data are determined us- 
ing a logical procedure, for example, as shown in 
Fig. 11. The examination IDs having the same 

45 patient and the same modality are retrieved to 
make a list of the examination IDs. Alternately, the 
examination IDs having the same patient and the 
same object are retrieved to make a list of the 
examination IDs. The examination IDs in one of the 

so above two lists which has a high priority are sorted 
in the reverse chronological order. 

The data base 12 selects images in units of 
examinations to be transferred by using the exami- 
nation ID as a retrieval key. The selected image 

55 data in units of examinations or the compressed 
image data if the data is read out from the storing 
deice 72, the relevant data, and the examination 
data in units of examinations are transferred to the 

6 
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network 16 via the network interface 74, and in turn 
to the workstation 1 4 sequentially. 

A section for performing a CAD will be de- 
scribed below. The CAD is to obtain CAD data, for 
example, denoting a position of an abnormality in 
the image, by processing image data using a com- 
puter. In this embodiment, for example, the work- 
station 14 serves as a section for obtaining the 
CAD data. 

Fig. 12 shows the arrangement of the work- 
station 14. The workstation 14 comprises an input 
device 80, an output device 82, an alarm generator 

83, a hard disk interface (HD l/F) 84, a semicon- 
ductor memory 86, a CPU 88, a timer 90, a ROM 
92, a network interface (LAN l/F) 94, a plurality of 
image memories 100, a plurality of CRT displays 
102, a hard disk unit (HD) 106, and a data expan- 
sion circuit 108. Of these components, the input 
device 80, the output device 82, the alarm gener- 
ator 83, the HD l/F 84, the semiconductor memory 
86, the CPU 88, the timer 90, the ROM 92, the 
LAN l/F 94, and the data expansion circuit 108 are 
connected to a control bus line 96. The output 
device 82, the alarm generator 83, the HD l/F 84, 
the semiconductor memory 86, the ROM 92, and 
the LAN l/F 94 are connected to a high speed bus 
line 98. The LAN l/F 94 is connected to the network 
16. 

The image memories 100 are provided in one- 
to-one correspondence with one or more (in this 
case, four) CRT displays 102, Each of the image 
memories 100 has two or three overlay screens 
(plane memories) and is connected to the output 
device 82. An output from the image memory 100 
is displayed on the corresponding CRT display 
102. The HD unit 106 is connected to the HD l/F 

84. In the workstation 14, the image data input via 
the LAN l/F 94 in the form of the compressed 
image data, the corresponding relevant data, and 
the examination data in units of examinations are 
stored in the HD unit 106. 

In order to perform an image reading, a doctor 
selects an image and the attribute data and the 
image is displayed on the CRT display 1 02 via the 
output device 82. The image to be displayed is 
selected among the images for one examination 
using the image ID input by the doctor. If the 
compressed image data is read out from the HD 
unit 106, the compressed data is expanded by the 
data expansion circuit 108 and then stored in the 
semiconductor memory 86. The relevant data and 
the examination data are also stored in the semi- 
conductor memory 86. The image data is read out 
from the semiconductor memory 86 and is dis- 
played on the CRT display 102 to be read or 
viewed by the doctor. For example, when an object 
to be image-read is a conventional X-ray radiog- 
raph, front and side images are usually displayed. 
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When the patient has been examined, both non- 
read and past images (other than the non-read 
image; reference image) are usually displayed to 
perform comparative image reading. 
5 The manner in which the images are displayed 

on the CRTs is registered in a CRT image display 
control table as shown in Fig. 14. The table is 
formed by associating the examination ID and the 
image ID with the serial number of the CRTs. The 
w table is stored in the semiconductor memory 86. 

The image data which are sequentially trans- 
ferred to the workstation 14 from the data base 12 
are sequentially processed with a predetermined 
CAD algorithm. 

75 A timing at which the CAD operation is started 

will be described below. After image data, exami- 
nation data, and relevant data of one patient are 
transferred to the HD unit 106 of the workstation 
1 4, the examination data and relevant data are read 

20 out sequentially from the HD unit 106 to the semi- 
conductor memory 86 by the CPU 88. 

Since the CAD operation is performed in which 
one of a plurality of different CAD algorithms suit- 
able for the image data is selected, the ROM 92 

25 includes a table indicating the name of a CAD 
algorithm and the items of the attribute data of the 
image data capable of being applied with the CAD 
algorithm, as shown in Fig. 15. The items of the 
attribute data of the image data to be analyzed and 

30 corresponding items of the attribute data of each 
CAD algorithm included in the table shown in Fig. 
15 are compared with each other to determine 
whether or not the CAD algorithm can be applied to 
the image data. For example, a CAD algorithm for 

35 an interstitial lung disease is performed only when 
the modality is a conventional radiograph, the ex- 
amination object is a chest, the imaging direction is 
a front, and the result of CAD is nothing. If the CAD 
algorithm is not applied to the image data, nothing 

40 is stored in the item of the result of CAD. If other 
than nothing is stored in the item of the result of 
CAD, it means that the CAD algorithm is used for 
the image data. Therefore, since the examination 
data (Fig. 2) and the relevant data (Fig. 6) are 

45 already read out into the semiconductor memory 
86, the items of modality and examination object 
are extracted from the examination data, and the 
items of imaging direction and result of CAD are 
extracted from the relevant data. These items are 

so compared with items for each algorithm stored in 
the table shown in Fig. 15. The table of Fig. 15 is 
read out from the ROM 92 and is stored in the 
semiconductor memory 86. If they are equal to 
each other, the image is determined to be an 

55 object to which the CAD algorithm is to be applied. 
Therefore, an arithmetic operation of the CAD al- 
gorithm corresponding to the image data is started. 
First, the image data determined to be an 
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object to which the CAD algorithm is to be applied 
is read out into the semiconductor memory 86. The 
CPU 88 executes the CAD algorithm stored in the 
ROM 92 and stores the result of CAD in the semi- 
conductor memory 86. The CPU 88 issues a serial 
number for the CAD ID and writes the CAD ID for 
retrieving the result of CAD in the item of the result 
of CAD in the relevant data (Fig. 6) stored in the 
semiconductor memory 86. The CPU 88 also 
writes the address storing the result of CAD in the 
relevant data. The default data of the address of 
the result of CAD is text data denoting nothing. 
When the operation for one CAD algorithm is end- 
ed, it is determined whether the next CAD al- 
gorithm can be applied to the image data. 

The examples of the CAD algorithm written in 
the ROM 92 are as follows. A CAD algorithm for 
detecting a micro calcification in mammography is 
disclosed in Unexamined Japanese Patent Applica- 
tion No. 2-152443. A CAD algorithm for measuring 
the size of the heart and lung is disclosed in United 
States Patent Application No. 275,720 (filed No- 
vember 23. 1988). A CAD algorithm for detecting 
an interstitial lung disease is formed of the follow- 
ing algorithms: 

#1: An algorithm (which is schematically shown 
in Fig. 17, and illustrated in detail in Fig. 18) for 
setting ROIs (symbolized by □ in Fig. 16) for the 
CAD algorithm for one frame of the image data. 
#2: An algorithm (which is schematically shown 
in Fig. 19) for calculating a physical amount of 
texture (which is an index indicating the mag- 
nitude and the length of period of a density 
variation in a texture pattern) in the ROL 
#3: An algorithm (the flow chart of which is 
shown in Fig. 20, and the arrangement in Fig. 
21) for applying a threshold to the calculated 
physical amount of texture to determine ab- 
normality or normality of the ROI. 
Of these algorithms, the algorithms #1 and #2 
are described in USP 4,851,984, and therefore a 
detailed description thereof will be omitted. In addi- 
tion, since the algorithms #3 is described in USP 
4,839,807, a detailed description thereof will be 
omitted. 

The results of the CAD algorithm and the clas- 
sification of the normality are temporarily stored in 
the semiconductor memory 86. The detailed de- 
scription for the case of the interstitial lung disease 
will be described. It is to be noted that "diffuse" is 
determined for those classified to be abnormal (i.e., 
those determined to be clustered abnormal ROIs in 
the flowchart shown in Fig. 20) because of the 
presence of clusters (grouped abnormal ROIs), and 
"local" is determined for abnormalities other than 
these; they are called patterns of abnormality. The 
pattern of abnormality is included as one item in 
the result of CAD of Fig. 22, and the type of pattern 
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is written in this item as text characters, e.g., de- 
noting local. Fig. 23 shows a practical example of 
the result of CAD in the case of an abnormal ROI. 
Here, a TPF represents a true positive fraction and 

5 an FPF represents a false positive fraction, failure. 
The ID of the result of CAD and the address of this 
CAD result data in the semiconductor memory 86 
are additionally written as items in the relevant data 
(Fig. 5). When the result of CAD is stored in the 

io data base 12, the ID and address are registered in 
the examination directory as shown in Fig. 9. The 
above operation is performed plural times if plural 
CAD algorithms can be applied to the image data. 
If plural results of CAD and addresses are ob- 

is tained, all the plural IDs and addresses are stored 
in the examination directory. 

The CAD result is output in response to ap- 
plication of an output request trigger. Therefore, 
while image reading is performed (a conventional 

20 X-ray radiograph of a chest is read or viewed in 
case of interstitial lung disease detection CAD), 
various commands including this output request 
must be input from the input device 80 of the 
workstation 14. In this embodiment, the description 

25 of the input device 80 will be given by using a 
touch panel type device. It is also possible to use a 
general device, such as a keyboard as the input 
device 80. 

Fig. 24 shows an example of the input device 

30 80. This touch panel comprises a command dis- 
play 110 on which the names of commands is 
displayed, a panel 112 on which the command 
display 110 is arranged, and a transparent sensor 
board 114 located on the command display 110. 

35 When a position corresponding to the name of a 
command is selectively touched with a finger, the 
sensor board 114 senses the touched portion. 

When, for example, several command buttons 
are displayed on the output device, an operator can 

40 recognize a command display through the sensor 
board 114. The operator selects a command by 
touching the sensor board 114, thus executing the 
command. A button (CAD button shown in Fig. 25) 
for requesting an output of a result of CAD is 

45 prepared (displayed) on the touch panel. Detecting 
depression on this CAD button on the touch panel 
is a trigger for requesting the CAD result output. 

Since the CAD result can be output in various 
modes, the mode of outputting the CAD result is 

so determined next. The CPU 88 reads out the rel- 
evant data (Fig. 6) corresponding to the examina- 
tion ID and image ID included in the CRT image 
display control table (Fig. 14). Further, the CPU 88 
reads out the CAD result ID and CAD result ad- 

55 dress from this relevant data, thereby reading out 
or retrieves the result of CAD (Fig. 22). 

An example of CAD result output is described 
below. The CPU 88 starts the program in the ROM 
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92 and outputs a CAD result (Fig. 23) relating to 
the abnormality to a corresponding output device 
according to the pattern of the abnormality. In this 
program, the item of data denoting the pattern of 
abnormality is extracted from the result of CAD 
(Fig. 23) relating to the abnormality and stored in 
the semiconductor memory 86. If the pattern of 
abnormality is a diffused pattern, a text sentence 
generator is activated in order to output an ab- 
normality alarm in the form of a text sentence. If 
the pattern of abnormality indicates local, the alarm 
(marker) generator 83 is activated in order to in- 
dicate the location of abnormality by means of a 
marker. 

In this case, the text sentence represents the 
location of abnormality on an image by means of 
words, thereby making an alarm. For this purpose, 
as shown in Fig. 26, a screen of the display is 
equally divided into six regions in advance, and a 
name is assigned to each region. A table (Fig. 27) 
showing a correspondence between the names and 
the x, y coordinates of the regions is stored in the 
ROM 92. The right and left is defined as viewed 
from the patient The CPU 88 starts the program in 
the ROM 92. In this program, the x, y coordinates 
of the location of the abnormal ROI is extracted 
from the CAD result and an expression of ab- 
normality is read out from the table shown in Fig. 
28 and stored in the ROM 92 in accordance with 
the location of the abnormality. The readout ex- 
pression data is stored in the semiconductor mem- 
ory 86 to be inserted into the text sentence. If 
plural CAD results are obtained, the above opera- 
tion is repeated for the number of the CAD results. 
The text sentence is, for example, "interstitial lung 
disease, upper right lung abnormal." In this case, 
the expression of the underlined portion changes in 
accordance with an abnormal portion. Subsequent- 
ly, character string data of the text sentence is 
converted into dot patterns in units of characters. 
Thereafter, with reference to the CRT image dis- 
play control table (Fig. 14), one text line (white) is 
provided in the uppermost stage of an image mem- 
ory 100 (overlay screen) corresponding to the CRT 
displaying the image, and dot patterns of black 
characters are stored in the text line of the image 
memory 100, as shown in Fig. 29. 

The marker is a means for representing the 
location of abnormality on an image by using an 
arrow. The CPU 88 of the workstation 14 starts the 
program in the ROM 92 and reads out the location 
of abnormality from the CAD result data (Fig. 22), 
thus forming the shape of a marker as shown in 
Fig. 29, based on a font pattern of the ROM 92. In 
this case, although d (diagonal of the square) = 
1.5 cm is preferable, d is not limited to this value 
but can be changed freely. The screen is divided 
into right and left portions as viewed from the 
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operator. If the location (the center of ROI indicated 
by a symbol x) of abnormality is present on the 
right side of the screen, the arrow shown in Fig. 30 
is converted directly into a bit pattern. If, by con- 
s trast, the location is present on the left side, the 
arrow of Fig. 30 is inverted symmetrically about a 
longitudinal line (alternate long and short dashed 
line in Fig. 30) including the center of ROI, i.e., in a 
mirrorlike manner and the resulting mirror image of 
10 the arrow as indicated by a broken line in Fig. 30 is 
converted into a bit pattern. 

In addition, the bit pattern data is written in a 
location corresponding to the position cf abnormal- 
ity in the image memory 100 (overlay memory) 
15 corresponding to the CRT displaying the image. If 
a plural CAD results are obtained, the above opera- 
tion is repeated until all the CAD results are read 
out and written into the overlay memory. The data 
in the image memory 100 (overlay memory) is 
20 displayed on the CRT overlapped with the image 
data. The display color of the bit pattern data of the 
marker is switched between black and white in 
synchronism with the timer 90. Thus, the effect of 
alarming of the marker is enhanced. It is noted that 
25 the period of switching is 2Hz. 

At this time, though all the CAD results are 
simultaneously displayed on the CRT, some of 
them may be selectively displayed. The names of 
buttons displayed on the touch panel are changed 
30 in accordance with the needs of the operator. For 
example, the names of the buttons are changed in 
accordance with the CAD algorithm now applying 
to the image data. A label "ID", "MC", and "BH" 
are provided for buttons in case of an interstitial 
35 lung disease detection CAD, micro calcification de- 
tection CAD, and heart size measuring CAD. When 
a CAD algorithm is selected, the CAD result cor- 
responding to the algorithm is written in the overlay 
memory and the other results are deleted from the 
40 overlay memory. 

Another mode of CAD result output will be 
described in which the CAD result has a hierarchi- 
cal structure. That is, a summary of the CAD result 
is output first by means of, e.g., the text sentence 
45 and the marker as described above, and then de- 
tails are output. For this purpose, a button for 
requesting a CAD detail output is prepared on the 
input device (touch panel) 80 (Fig. 25) of the work- 
station 14. In other words, the names of buttons on 
so the touch panel are changed in accordance with 
the application used by an operator. When depres- 
sion on the CAD detail output button on the touch 
panel is sensed while the text sentence and the 
marker are displayed, a trigger for requesting an 
55 output of the CAD detailed result is generated. 

The output of the CAD detailed result will be 
described below. It is assumed that the text sen- 
tence is already formed and stored in the form of 
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black characters on a white background as shown 
in Fig. 29 in the image memory 100 (overlay 
screen). The CPU 88 starts the program in the 
ROM 92 to read out the CAD result data (Fig. 22) 
from the semiconductor memory 86. The CPU 88 
forms an arrow marker for data having abnormality 
independently of the pattern of the abnormality. 
The marker indicates the location of the abnormal- 
ity on an image by means of an arrow. 

The CPU 88 reads -out the location of the 
abnormality and forms the shape of the marker as 
shown in Fig. 31, based on the font pattern in the 
ROM 92. At this time, the screen is divided into 
right and left portions. If the abnormality location is 
present on the right side viewed from the operator, 
the arrow of Fig. 31 is converted directly into a bit 
pattern. If, on the other hand, the abnormality loca- 
tion is present on the left side, the arrow of Fig. 31 
is mirrorlike-inverted symmetrically about a longitu- 
dinal line (alternate long and short dashed line in 
Fig. 31) including the location of the abnormality, 
and the resultant mirrorlike arrow as indicated by a 
broken line in Fig. 31 is converted into a bit pat- 
tern. In addition, the type (e.g., nodular) and the 
degree (e.g., 75%) of the abnormality are read out 
from the CAD result data and are converted into a 
bit pattern, as shown in Fig. 31. Unlike the bit 
pattern of the arrow, the bit pattern of characters of 
the type and degree is not mirrorlike-inverted re- 
gardless of whether the abnormality location is 
present on the right side or the left side. 

This bit pattern data is written in a location 
corresponding to the position of the abnormality in 
the image memory 100 (overlay screen) corre- 
sponding to the CRT 102 displaying the image. As 
a result, the arrow marker associated with the char- 
acters indicating the type and the degree of the 
abnormality (Fig. 31) is displayed, together with the 
text sentence shown in Fig. 29, on the screen. 

The data in the image memory 100 (overlay 
screen) is displayed overlapped on the examination 
image. At this time, the color of the data display on 
the overlay screen is switched between black and 
white in synchronism with the timer 90. The period 
of switching is 2Hz. 

An example of an option output of the CAD 
detailed result will be described below. As in the 
case of the trigger for the detailed output, a button 
for requesting a detailed option output of the CAD 
result is displayed on the input device (touch pan- 
el) 80 of the workstation 14 as a trigger for the 
option output. When depression on the CAD de- 
tailed option output button on the touch panel is 
sensed while the detailed output is performed, the 
trigger for requesting the CAD detailed option out- 
put is attained. 

It is supposed that the text sentence is already 
formed and stored in the form of black characters 
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on a white background as shown in Fig. 29 in the 
image memory 100 (overlay screen). The CPU 88 
starts the program in the ROM 92 to read out the 
CAD result data (Fig. 22) from the semiconductor 
5 memory 86 and forms an arrow marker for data 
having abnormality independently of the pattern of 
the abnormality. This marker represents the loca- 
tion of the abnormality on the image by means of 
an arrow. 

10 The CPU 88 reads out the location of the 

abnormality and forms an arrow marker and a 
square ROI marker, as shown in Fig. 32, based on 
the font pattern of the ROM 92. Here, the screen is 
divided into right and left portions. If the abnormal- 

75 ity location is present on the right side, the arrow 
and the ROI of Fig. 32 are converted directly into 
bit patterns. If the location is present on the left 
side, the arrow of Fig. 32 is inverted in a mirrorlike 
manner, and the resulting arrow indicated by a 

20 broken line in Fig. 32 and the ROI are converted 
into bit patterns. This bit pattern data is written in 
the location corresponding to the position of the 
abnormality in the image memory 100 (overlay 
screen) corresponding to the CRT displaying the 

25 image in the CRT display image control table (Fig. 
12). 

The data in the image memory 100 (overlay 
screen) is displayed overlapped on the examination 
image. At this time, the color of the data display on 

30 the overlay screen is switched between black and 
white in synchronism with the timer 90. The period 
of switching is 2Hz. 

Another example of the option output will be 
described. When another option output is request- 

35 ed, the CPU 88 starts a given program in the ROM 
92 to read out ROC (Receiver Operator Curve) data 
included in the CAD result from the semiconductor 
memory 86, thus forming an ROC curve. As shown 
in Fig. 33, the ROC curve is one of examples for 

40 indicting the ability of CAD and is so formed as to 
be fitted in a portion below and to the right of the 
image. In the ROC curve, the abscissa denotes the 
FPF and the ordinate denotes the TPF. The ROC 
curve is converted into a bit pattern. The bit pattern 

45 data is written in the image memory 100 (overlay 
screen) corresponding to the CRT displaying the 
image. The data in the image memory (overlay 
memory) 100 is displayed on the CRT overlapped 
with the examination image. 

so An example of a request trigger for ending the 

output of the CAD result will be described below. 
When the image reading of a conventional X-ray 
radiograph of a chest is performed and the image 
and the CAD result are displayed on a CRT screen, 

55 the trigger for ending the CAD result output is 
automatically generated upon stopping the image 
display in order to display another image. When 
the output is ended, the image display is contin- 
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ued, and only the display on the overlay screen is 
turned off. Further, the touch panel may include a 
button for providing the command representing the 
end of the image reading and the relevant data is 
updated as being read if the button is depressed. 

A command for requesting the end of the CAD 
output can also be applied from the input device 80 
of touch panel type. 

It is to be noted that the CAD data is preferably 
stored even when its output (display) is stopped. 
The CAD result is added to the updated relevant 
data, as shown in Fig. 34, and supplied to the data 
base 12 to be stored therein. In the data base 12, 
all the CAD IDs and CAD result addresses in the 
relevant data are stored in the examination direc- 
tory (Fig. 9). In a subsequent image reading, if an 
image transfer request is supplied to the data base 
12, the image data and the corresponding examina- 
tion and relevant data are transferred by the net- 
work 16 and stored in the semiconductor memory 
86 of the workstation 14. At the same time, the 
CAD result ID is read out and all the CAD results 
are retrieved based on the CAD IDs. In this case, 
as shown in Fig. 35, the address of the CAD result 
written in the relevant data is converted into the 
address on the semiconductor memory 86 and is 
stored in the relevant data. 

According to this embodiment as has been 
described above, the following effects can be ob- 
tained. That is, in addition to a medical image, CAD 
data concerning the image is also displayed. 
Therefore, an erroneous diagnosis due to an over- 
sight of a disease can be prevented in medical 
image diagnosis, thus increasing diagnosis preci- 
sion. Labors can be reduced in a diagnosis opera- 
tion performed by a doctor (operator). In medical 
image diagnosis, particularly in an image reading 
operation, an erroneous diagnosis caused by an 
oversight of a disease can be prevented to improve 
diagnosis precision. Since the CAD data is ob- 
tained by analyzing medical images using a com- 
puter, objective and quantitative results can be 
obtained. Therefore, it is possible to prevent an 
erroneous diagnosis which is a result of subjective 
determination by a human being ? and consequently 
diagnosis precision can be increased. In medical 
image diagnosis, a doctor who is not an expert of 
an image of interest sometimes cannot make a 
satisfactory diagnosis. According to the present 
invention, diagnosis precision can be improved also 
in this case. 

As the CAD data, the position, the type, or the 
degree of abnormality is displayed, so that the 
abnormality can be readily recognized. As a result, 
an erroneous diagnosis caused by an oversight of 
a disease can be prevented to improve diagnosis 
precision. 

Arithmetic operation calculating the CAD data 
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is started by a computer before an output request 
for the CAD data is generated. Therefore, it is 
possible to shorten a time from generating the 
output request to displaying the CAD data. 

5 When several algorithms for obtaining CAD 

data are available, an inappropriate processing is 
performed for an image data of interest unless the 
image data is correctly assigned to the algorithm, 
and erroneous CAD data results. According to this 

w embodiment, however, since a suitable algorithm is 
selected for each image, output of erroneous CAD 
data can be prevented to increase diagnosis preci- 
sion. 

Since the CAD result is stored in the data base 

is 12, an image which is diagnosed once need not be 
analyzed again. 

A CAD algorithm is determined for each di- 
agnosis of interest, and the algorithms are selec- 
tively executed in accordance with each object. 

20 Therefore, it is possible to prevent a production of 
CAD data which may cause an erroneous diagnosis 
in the case when an unsuitable algorithm is applied 
to an object. Further, the attribute data includes the 
modality, the examining object, and the imaging 

25 direction, and an algorithm is executed when these 
items of the attribute data coincide with those of an 
object image of the algorithm. Therefore, an unsuit- 
able algorithm is not applied to the image. 

An alarming means which strongly attracts at- 

30 tention of the doctor is used as a means for alarm- 
ing abnormality. Therefore, an erroneous diagnosis 
due to an oversight can be prevented to increase 
diagnosis precision. An optimal alarming means is 
selected to attract attention in accordance with the 

35 type of abnormality. Therefore, it is possible to 
prevent an erroneous diagnosis caused by an over- 
sight, thus improving diagnosis precision. By flick- 
ering the alarm display, the alarming means strong- 
ly attracts attention to prevent an erroneous di- 

40 agnosis resulting from an oversight, thus improving 
diagnosis precision. 

The CAD data is hierarchically constructed and 
output gradually from its summary to details. 
Therefore, a large number of different types of 

45 CAD data are not simultaneously displayed to 
cause a cumbersome operation. Thus, an erro- 
neous diagnosis can be prevented to increase di- 
agnosis precision. For example, the position of 
abnormality alone is output first as the CAD data. If 

so the abnormality cannot be clearly determined, a 
doctor freely makes output requests for, e.g., the 
degree, the type, and the pattern of the abnormal- 
ity, thus avoiding a cumbersome operation to in- 
crease diagnosis precision. In this case, a usable 

55 command (button) is prepared for each level 
(hierarchical level) of contents at which the CAD 
data is output. Since a user need only select a 
command of interest from the prepared commands, 
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a labor for selecting from a large number of com- 
mands is reduced. 

Before application of the CAD algorithm to a 
given image data, it is determined whether the 
CAD algorithm can be applied to the image data 
based on the attribute data of the image data and 
only the algorithm which is determined to be able 
to apply to the image data is applied to the image 
data. Therefore, it is possible to prevent lowering 
the quality and precision of diagnosis due to the 
output of the erroneous CAD data. 

The CAD system according to the present in- 
vention is described as being incorporated into the 
PACS. However, it is possible to realize a stand- 
alone type CAD system according to the present 
invention. 

Plural CAD algorithms are stored in the system 
and an optimum one is automatically selected 
based on the relevant data of the object image 
data. Therefore, it is possible to reduce the labors 
of the doctor for selecting the suitable algorithm, 
inputting the respective image data, and outputting 
the respective CAD data. 

The computer starts an arithmetic operation for 
calculating the CAD data before an output request 
for the CAD data is generated. Therefore, it is 
possible to shorten a time from generating the 
output request to displaying the CAD data. 

The numerical data denoting the CAD result 
includes many items. If ail the data are output, the 
output becomes complicate. According to the first 
embodiment, the CAD data are stored in the form 
of a table and only desired data is output by 
retrieving the data from the table using the retrieval 
key corresponding to the desired condition. There- 
fore, the CAD result can be output in a simple 
form. 

The attribute data includes an item of data 
denoting whether or not the image data has been 
read or viewed. Based on this attribute data, the 
CAD result of the image data which has been read 
or viewed is not output. Therefore, it is possible to 
prevent a confusion in which the CAD result dif- 
ferent from the reading report is output. Based on 
this attribute data, only the image data which has 
not been read or viewed is analyzed using the CAD 
algorithm. Therefore, a time from generating the 
output request to displaying the CAD data be- 
comes shorter than that in the case of all the image 
data are analyzed. Further, the attribute data in- 
cludes an item of data representing the CAD result 
and the image data which has been analyzed is not 
analyzed again. Therefore, it is possible to further 
shorten a time from generating the output request 
to displaying the CAD data. 

Other embodiments of the present invention 
will be described below. 

A second embodiment comprises, in addition 
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to the workstation 14 for displaying the image as 
shown in Fig. 12, a workstation 14a having a CAD 
processor 120 as shown in Fig. 36. This work- 
station 1 4a for obtaining CAD data is different from 

s the workstation 14 in that a controller 90a is pro- 
vided in place of the timer 90. In terms of an 
operation, the second embodiment is different from 
the first embodiment in a timing at which a CAD 
arithmetic operation is started. 

'o In the second embodiment, when image data, 

examination data, and relevant data of one patient 
are transferred to the HD unit 106 of the work- 
station 14a, the examination data and the relevant 
data are read out sequentially from the HD unit 106 

75 into the semiconductor memory 86 by the CPU 88. 
The ROM 92 stores the table denoting the relation- 
ship between the name of the CAD algorithm and 
the attribute data of the image data which can be 
adapted to the CAD algorithm as shown in Fig. 15. 

20 Therefore, since the examination data (Fig. 2) and 
the relevant data (Fig. 6) are already read out into 
the semiconductor memory 86, the modality and 
the examining object are read out from the exami- 
nation data, and the imaging direction is read out 

25 from the relevant data. These read out items of 
data are stored in the semiconductor memory 86. 
These items of data are compared with the at- 
tribute data of the image stored in the table (Fig. 
15) of the ROM 92. 

30 If these items are coincide with those of a 

given CAD algorithm, e.g., interstitial lung disease 
detection CAD, this image is determined to be an 
image to which the interstitial lung disease detec- 
tion CAD algorithm can be applied, and the opera- 

35 tion of the CAD is started. At this time, the CPU 88 
in the workstation 14a designates activation of the 
CAD processor 120 (Fig. 36), and supplies input 
data to the processor 120. The input data given to 
the CAD processor 120 includes the image data, 

40 the examination data, and the relevant data. The 
CAD processor 120 has its own CPU, and by 
means of the CPU it executes the CAD operation 
and outputs a CAD result. The CAD result is tem- 
porarily stored in the memory as data having the 

45 format shown in Fig. 22. In addition, the ID and the 
address of the CAD result data are additionally 
written in the relevant data (Fig. 6). 

As described above, according to the second 
embodiment, since the display and the CAD 

so arithmetic operation are separately performed at 
different workstations 14 and 14a, a processing 
time for the CAD can be shortened. That is, if a 
CAD processing is performed at devices such as 
the modality 10, the workstation 14, and the data 

55 base 12, a long processing time is required for 
they share a single CPU. However, since the CAD 
processor 120 has a CPU 88 for a processing 
purpose only, the processing time is shortened. 

11 
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A third embodiment is different from the first 
embodiment in that a CAD result is output as a 
sound. For this purpose, a workstation of this em- 
bodiment has a sound generator as shown in Fig. 
37 in addition to the arrangement shown in Fig. 10. 
The CPU 88 of the workstation 14 reads out rel- 
evant data using the CRT image display control 
table (Fig. 14). The CPU 88 also reads out CAD 
results (Fig. 22) by reading out the CAD result 
address from the relevant data. When the CAD 
result is to be output, the CPU 88 starts a program 
in the ROM 92 and assigns the CAD result having 
abnormality to a corresponding output device in 
accordance with the pattern of the abnormality. In 
this program, the CAD results and the classification 
of the CAD result are read out from the semicon- 
ductor memory 86, and, if the type of abnormality 
indicates "diffuse", a text sentence generator is 
activated in order to output an abnormality alarm in 
the form of a text sentence. If the type of ab- 
normality indicates "local", a marker generator and 
the sound generator shown in Fig. 37 are activated 
in order to indicate the position of the abnormality 
by means of a marker and a sound. 

When the CAD operation result is read out 
from the semiconductor memory 86, if the pattern 
of abnormality indicates "local", a sound of 
"abnormality present" is simply generated. If, how- 
ever, the pattern of abnormality indicates "diffuse", 
a statement formed as a text sentence is automati- 
cally read. The text sentence is, for example, 
"interstitial lung disease, upper right lung abnor- 
mal." The expression in the underlined portion 
changes in accordance with an abnormal portion. 
Next, the CPU 88 activates a program in the ROM 
122 and converts character string data in the text 
sentence into a voice sound. "Interstitial lung dis- 
ease, upper right lung abnormal" is stated by gen- 
erating three groups of words, interstitial lung dis- 
ease, upper right lung t and abnormal. Since the 
expression in the underlined portion changes in 
accordance with an abnormal portion as described 
above, a sound data base 124 is also provided to 
generate words for this purpose. 

According to the third embodiment as de- 
scribed above, in specifying the position of ab- 
normality by means of a sentence or a sound, 
words representing a position are used to make it 
easy to recognize the abnormality. Therefore, an 
oversight of a disease and consequently an erro- 
neous diagnosis can be prevented to lead to an 
increase in diagnosis precision. 

As a fourth embodiment, an embodiment of 
automatically outputting a CAD result will be ex- 
plained. The arrangement of a workstation of the 
fourth embodiment is identical to that of the first 
embodiment shown in Fig. 12. In the fourth em- 
bodiment, however, even if no CAD result request 



BNSOOCtD: <EP CW87110A2J_> 



is present during image reading of a conventional 
X-ray radiograph of chest, the result is automati- 
cally displayed. 

For this purpose, each time an image is dis- 

5 played, the CPU 88 refers to the CRT image dis- 
play control table (Fig. 14) and checks whether the 
ID of the CAD result is included in the relevant data 
of the displayed image, i.e., whether nothing is 
stored in the CAD result ID, and in this manner 

w checks whether the displayed image is an object of 
the CAD. If the CPU 88 determines that the dis- 
played image is an object of the CAD, it measures 
a predetermined time from the start of image dis- 
play by means of the timer 90, and automatically 

75 generates a trigger for requesting a CAD result 
output when the predetermined time has elapsed. 
This predetermined time can be arbitrarily 
changed. 

In this manner, the output request for the CAD 
20 data can be omitted, and this results in a reduction 
in labors. In addition, if the CAD data is output 
immediately after an image is displayed, an oper- 
ator or doctor may have a preconceived knowl- 
edge. Therefore, CAD data is output when a certain 
25 time has elapsed after an image is displayed. As a 
consequence, an erroneous diagnosis due to an 
oversight is prevented to improve diagnosis preci- 
sion. 

A fifth embodiment as another example of 

30 automatically outputting the CAD result will be de- 
scribed. Here, the arrangement of a workstation of 
this embodiment is also the same as that shown in 
Fig. 12. First, each time an image is displayed, the 
CPU 88 refers to the CRT image display control 

35 table (Fig. 14) and checks whether the ID of the 
CAD result is included in the relevant data of the 
displayed image, i.e., whether nothing is stored in 
the CAD result ID, and in this manner checks 
whether the displayed image is an object of the 

40 CAD. If the CPU 88 determines that the displayed 
image is an object of the CAD, it measures a 
number of times (the number of applications of the 
CAD algorithm) at which the image is displayed 
from the start of the image reading for the patient 

45 and writes the number of times into the relevant 
data (Fig. 6). The number of times is initially set to 
zero and increased by one every time the image is 
displayed. The CPU 88 automatically generates a 
trigger for requesting a CAD result output when the 

so number of times reaches a predetermined time 
which can be arbitrarily set. 

In this manner, since an output request for 
CAD data can be omitted, labors can be reduced. 
In addition, if CAD data is output immediately after 

55 an image is displayed, an operator or doctor may 
have a preoccupied knowledge. Therefore, CAD 
data is not output when an image is displayed for 
the first time and image reading is performed but 

12 



23 



EP 0 487 110 A2 



24 



output when the image is displayed for a predeter- 
mined time or the image display is switched. The 
result is that an erroneous diagnosis caused by an 
oversight is prevented to improve diagnosis preci- 
sion. 

The fourth and fifth embodiments are embodi- 
ments automatically outputting a CAD result. Next, 
a sixth embodiment of automatically ending output- 
ting of a CAD result will be described. The arrange- 
ment of a workstation of this embodiment is iden- 
tical to that shown in Fig. 12. When, for example, 
image reading of a conventional radiograph of a 
chest is performed, a display of the CAD result is 
automatically stopped even if no CAD result re- 
quest is present. For this purpose, each time an 
image is displayed, the CPU 88 refers to the CRT 
image display control table (Fig. 14) and checks 
whether the ID of the CAD result is included in the 
relevant data of the displayed image, i.e., whether 
nothing is stored in the CAD result ID, and in this 
manner checks whether the displayed image is an 
object of the CAD. If the CPU 88 determines that 
the displayed image is an object of the CAD, it 
measures a predetermined time from the start of 
image display by means of the timer 90, and 
automatically generates a trigger for requesting the 
end of the CAD result output when the predeter- 
mined time has elapsed. This predetermined time 
can be arbitrarily changed. Upon the end of output- 
ting, the CPU 88 turns off all overlay screens 
displayed on CRTs. 

According to this embodiment, since an output 
end request for CAD data can be omitted, labors 
are reduced. In addition, CAD data remaining on an 
image for a long time makes it difficult for an 
operator or doctor to observe details of an image. 
As in this embodiment however, by automatically 
ending display of CAD data after the data has been 
displayed for a predetermined time, an erroneous 
diagnosis is prevented to increase diagnosis preci- 
sion. 

Various commands must be input in the 
present invention, so a seventh embodiment relat- 
ing to a modification of the input device will be 
described below. During image reading of a con- 
ventional radiograph of a chest, when an icon dis- 
played on a CRT screen is designated (clicked) by 
a pointing device such as a mouse, a menu win- 
dow as shown in Fig. 38A appears at a corner, in 
this case, the upper right corner of the screen. It is 
to be noted that this menu window shows only 
buttons which can be used by an operator at the 
time of click. If it is electrically sensed that a CAD 
button in the menu window on the screen is des- 
ignated by the pointing device, a trigger for re- 
questing a CAD result output is generated. 

Similarly, when the icon displayed on the CRT 
screen is designated (clicked) by the pointing de- 



vice such as a mouse, as shown in Fig. 38B, while 
the CAD output is performed, the menu window 
emerges. If a button for requesting a CAD detail 
result output in the menu window is designated, a 
5 trigger for requesting the CAD detail result output 
is generated. When the icon displayed on the CRT 
screen is designated (clicked) by the pointing de- 
vice such as a mouse while the CAD output is 
performed, the menu window appears. If a button 
io for requesting an option output in the menu window 
is designated, a trigger for requesting an option 
output is generated. When the icon displayed on 
the CRT screen is designated (clicked) by the 
pointing device such as a mouse while the CAD 
75 output is performed, the menu window emerges. If 
a button for requesting a CAD diagnosis level out- 
put in the menu window is designated, a trigger for 
requesting the CAD diagnosis level output is gen- 
erated. When the icon displayed on the CRT 
20 screen is designated (clicked) by the pointing de- 
vice such as a mouse while the CAD output is 
performed, the menu window appears. If a button 
for requesting a CAD result output end in the menu 
window is designated, a trigger for requesting the 
25 CAD detail output end is generated. Upon the end 
of outputting, overlay screens are turned off. 

According to this embodiment as described 
above, a menu window including buttons having 
command names is displayed on the CRT screen. 
30 By designating a command with by means of a 
pointing device such as a mouse, a command for 
outputting CAD data can be input. In addition, since 
the menu window is not constantly displayed but 
can be selectively displayed, an operator (doctor) 
35 can display commands only when he or she needs 
them. Therefore, an annoyance caused by frequent 
changes in commands displayed can be reduced. 
In this case, a usable menu is prepared for each 
level (hierarchical level) of the contents of CAD 
40 data to be output. Therefore, since a user need 
only select a menu of interest from the prepared 
menus, a labor of selecting from a large number of 
menus is reduced. 

An eighth embodiment concerned with coloring 
45 of a marker and a text sentence will be described 
below. The arrangement of a workstation is the 
same as that shown in Fig. 12. With reference to 
the CRT image display control table (Fig. 14), an 
overlay screen corresponding to a CRT not having 
so "nothing" in the ID of the CAD result of relevant 
data of a displayed image is overlaid on the exami- 
nation image displayed on the CRT. At this time, 
the data displayed on the overlay screen is flic- 
kered in an arbitrary color, such as red, while being 
55 synchronized by the timer 90. The period of flicker- 
ing is 2 Hz. 

According to the eighth embodiment, it is pos- 
sible to strongly attract attention because of the 
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color of the alarm display. As a result, an erro- 
neous diagnosis caused by an oversight can be 
prevented to consequently increase diagnosis pre- 
cision. This effect can be further enhanced by 
flickering the alarm display. 

A ninth embodiment in which a CAD arithmetic 
operation is started by the modality, such as a film 
digitizer 18 (Fig. 4) will be described. The arrange- 
ment of a workstation is identical to that shown in 
Fig. 12. In this embodiment, when the film digitizer 
18 digitizes all the image data for one patient and 
inputs the imaging direction, the CPU 88 reads out 
examination data and relevant data sequentially 
from the HD unit 106 into the semiconductor mem- 
ory 86. In order to refer to the table (Fig. 15) of 
CAD algorithms and corresponding attribute data, 
the modality and the examination object are read 
out from the examination data (Fig. 2) and the 
imaging direction and the CAD result ID address 
are read out from the relevant data (Fig. 6). These 
readout items of data are stored in the semicon- 
ductor memory 86. These items of data are com- 
pared with the attribute data of the image stored in 
the table (Fig. 15) of the ROM 92. If these items 
are coincide with those of a given CAD algorithm, 
this image is determined to be an image to which 
the given CAD algorithm can be applied, and the 
operation of the CAD is started. 

Upon the start of the CAD operation, image 
data determined to be an object of the CAD is read 
out into the semiconductor memory 86. The CPU 
88 executes a CAD operation program written in 
the ROM 92 and stores the result in the semicon- 
ductor memory 86. The CPU 88 transfers, as data 
flowing through the network 16, the image data, the 
relevant data, the CAD result, and the examination 
data (for each examination) to the data base 12 via 
the LAN l/F 94. As shown in Fig. 34, the data base 
12 handles the CAD result data as a part of the 
relevant data. 

When data is transferred to the workstation 14 
during image reading, the transferred data is tem- 
porarily stored in the HD unit 106. However, the 
CAD result is read out from the HD unit 106 into 
the semiconductor memory 86 upon reception of a 
CAD output request as a trigger. In this case, the 
workstation 14 does not perform any operation 
associated with the CAD but simply displays the 
CAD result. Whenever an image is displayed on 
the image display device (workstation), the CAD 
result for the displayed image is stored in the 
semiconductor memory 86. Therefore, a time from 
generation of an output request to display the CAD 
result is shortened. 

In a tenth embodiment, a timing at which an 
arithmetic operation of a CAD is started is when all 
the image data of one patient is transferred to the 
data base 12. At this time, the CPU 88 reads out 



examination data and relevant data sequentially 
from the HD unit 106 into the semiconductor mem- 
ory 86. In order to refer to the table (Fig. 15) of 
CAD algorithms and corresponding attribute data, 

5 the modality and the examination object are read 
out from the examination data (Fig. 2) and the 
imaging direction and the CAD result ID address 
are read out from the relevant data (Fig. 6). These 
readout items of data are stored in the semicon- 

70 ductor memory 86. These items of data are com- 
pared with the attribute data of the image stored in 
the table (Fig. 15) of the ROM 92. If these items 
are coincide with those of a given CAD algorithm, 
this image is determined to be an image to which 

is the given CAD algorithm can be applied, and the 
operation of the CAD is started. 

Upon the start of the CAD operation, image 
data determined to be an object of the CAD is read 
out into the semiconductor memory 86. The CPU 

20 88 executes a CAD operation program written in 
the ROM 92 and stores the result in the semicon- 
ductor memory 86. The CPU 88 transfers, as data 
flowing through the network 16, the image data, the 
relevant data, the CAD result, and the examination 

25 data (for each examination) to the data base 12 via 
the LAN l/F 94. As shown in Fig. 34, the data base 
12 handles the CAD result data as a part of the 
relevant data. 

When data is transferred to the workstation 14 

30 during image reading, the transferred data is tem- 
porarily stored in the HD unit 106. However, the 
CAD result is read out from the HD unit 106 into 
the semiconductor memory 86 upon reception of a 
CAD output request as a trigger. In this case, the 

35 workstation 14 does not perform any operation 
associated with the CAD but simply displays the 
CAD result. Whenever an image is displayed on 
the image display device (workstation), the CAD 
result for the displayed image is stored in the 

40 semiconductor memory 86. Therefore, a time from 
generation of an output request to display the CAD 
result is shortened. 

Fig. 39 is a block diagram showing the ar- 
rangement of an eleventh embodiment. In the elev- 

45 enth embodiment, a CAD processor 14a as shown 
in Fig. 36 is connected to the arrangement of the 
PACS shown in Fig. 1 . When a request of starting 
a CAD operation is generated in the workstation 14, 
the CAD processor 1 4a is used to perform only the 

so CAD operation at a high speed. Therefore, the 
workstation 14 transfers data required for the CAD 
operation to the CAD processor 14a, and only the 
result is returned to the workstation 14. 

A timing at which the CAD operation is started 

55 is similar to that in the tenth embodiment. However, 
unlike in the tenth embodiment, the CAD operation 
is performed by the CAD processor 14a. The work- 
station 1 4 supplies the image data, the examination 

14 
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data, and the relevant data to the CAD processor 
14a via the network 16. As shown in Fig. 36, the 
CAD processor 14a has its own CPU, and by 
means of the CPU it executes the CAD operation 
and outputs the CAD result. The result of the CAD 
operation is transferred as result data having the 
format shown in Rg. 22 to the workstation 14 via 
the network 16. As shown in Rg. 34, the work- 
station 14 or the data base 12 handles the CAD 
result as a part of the relevant data. 

When data is transferred to the workstation 14 
during image reading, the transferred data is tem- 
porarily stored in the HD unit 106. The CAD result, 
however, is read out from the HD unit 106 into the 
semiconductor memory 86 upon reception of an 
output request for the CAD as a trigger. In this 
case, the workstation 14 does not perform any 
operation associated with the CAD but simply dis- 
plays the result. 

Processing executed by devices such as the 
modality, the workstation, and the data base takes 
a long processing time for they share a CPU. In 
this embodiment, however, since the processor 
having a CPU for a processing purpose only ex- 
ecutes the processing, a processing time can be 
shortened. 

As a twelfth embodiment, an embodiment con- 
cerned with a modification of a marker will be 
described below. Figs. 40A to 40E show modifica- 
tions of a marker for pointing the ROI, and Figs. 
41 A to 41 F show modifications of a marker for 
surrounding the ROI. Pointing the ROI includes a 
case in which the direction of an arrow points the 
center of the ROI as shown in Fig. 42A and a case 
in which it points a position other than the center 
as shown in Fig. 42B. 

According to this embodiment, an alarming 
means which strongly attracts attention is used in 
order to alarm abnormality. Therefore, an oversight 
and therefore an erroneous diagnosis can be pre- 
vented, and this results in an improvement in di- 
agnosis precision. 

A thirteenth embodiment in which an on/off of 
the CAD result display is controlled for each of the 
CRTs will be described. The touch panel includes 
plural CAD result display buttons provided for the 
respective CRTs. In order to display only the CAD 
result on the CRT #i, it is necessary to depress 
the CAD result display buttons for the CRT #1. 
When the depression of that button is detected, the 
ID of the image displayed on the CRT #1 is read 
out from the CRT display control table (Fig. 14). 
The CAD result address is read out from the rel- 
evant data of the image and the CAD result data is 
written into the overlay memory for the CRT #1, 
thereby displaying the CAD result overlapped on 
the image. As described above, the operation of 
this embodiment is the same as that of the first 



embodiment except that the image ID is read out 
from the CRT display control table. If no CAD 
result address is stored (nothing is stored in the 
CAD result ID), the same operation as the first 
5 embodiment is performed from application of a 
suitable CAD algorithm to the image data to writing 
the CAD result address into the table. 

According to the thirteenth embodiment, only 
necessary CAD results are selectively displayed 

io during the reading of the images displayed on the 
CRTs of the workstation, therefore, the display is 
not complicate due to the omission of display of 
unnecessary CAD result. 

A fourteenth embodiment which is a modifica- 

15 tion of the thirteenth embodiment will be descried. 
In this embodiment, when the image ID of the CRT 
display control table is updated upon changing the 
image to be displayed, the CAD result address is 
read out from the relevant data of the new image 

20 and the CAD result is written into the overlay 
memory, thereby displaying the CAD result over- 
lapped on the image. That is, when the image ID is 
designated, the CAD result is automatically dis- 
played regardless of whether or not the image has 

25 been read. If no CAD result address is stored 
(nothing is stored in the CAD result ID), the same 
operation as the first embodiment is performed 
from application of a suitable CAD algorithm to the 
image data to writing the CAD result address into 

30 the table. When the depression of the CAD display 
button for a reference image (an image other than 
the image which has been read), the IDs of the 
images displayed on the CRTs are read out from 
the CRT display control table (Fig. 14) and it is 

35 determined whether or not the image has been 
read. If the image has been read, the CAD result 
address is read out from the relevant data and the 
CAD result is written into the overlay memory, 
thereby displaying the CAD result overlapped on 

40 the image. For all the CRTs, this operation is 
performed. It is to be noted that all the data in the 
overlay memory are deleted before the CAD result 
is written into the memory. 

According to the fourteenth embodiment, since 

45 the CAD result is automatically output upon chang- 
ing the image to be displayed, labors for instructing 
the CAD result output. It is possible to make a 
comparison diagnosis with reference to the refer- 
ence image which has been read, thereby improv- 

50 ing the diagnosis precision. 

A fifteenth embodiment as a modification of the 
thirteenth embodiment will be described. The touch 
panel includes a single CAD result display button 
provided for all the CRTs. When the depression of 

55 the display button is detected, the IDs of the im- 
ages displayed on the CRTs are read out from the 
CRT display control table (Rg. 14). The CAD result 
addresses for all the images are read out from the 

15 



BNSDOCID: <EP_CW87110A2J_> 



29 



EP 0 487 110 A2 



30 



relevant data and the CAD result data are written 
into the overlay memories for all the CRTs, thereby 
displaying the CAD results overlapped on the im- 
ages. The CAD results are automatically displayed 
regardless of whether or not the images have been 
read. If no CAD result address is stored (nothing is 
stored in the CAD result ID), the same operation as 
the first embodiment is performed from application 
of a suitable CAD algorithm to the image data to 
writing the CAD result address into the table. 

According to the fifteenth embodiment, since it 
is possible to make a comparison diagnosis with 
reference to the reference image which has been 
read, thereby improving the diagnosis precision. 
When the CAD result display is desired, it is suffi- 
cient to touch only one button so that the operation 
is simple. 

A sixteenth embodiment which is a further 
modification of the thirteenth embodiment will be 
described. The touch panel includes a CAD result 
display button for the image which has not been 
read and a CAD result display button for the refer- 
ence image (an image other than the image which 
has not been read). When the depression of the 
CAD result display button for the image which has 
not been read is detected, the IDs of the images 
displayed on the CRTs are read out from the CRT 
display control table (Fig. 14). It is determined 
whether or not the image has not been read based 
on the relevant data of the image. If the image is 
detected as being not read, the CAD result address 
is read out from the relevant data of the image and 
the CAD result data is written into the overlay 
memory- All the data in the overlay memory are 
deleted before the CAD result is written into the 
memory. When the depression of the CAD result 
display button for the reference image is detected, 
the IDs of the images displayed on the CRTs are 
read out from the CRT display control table (Fig. 
14). It is determined whether or not the image has 
not been read based on the relevant data of the 
image. If the image is detected as being not read, 
the CAD result address is read out from the rel- 
evant data of the image and the CAD result data is 
written into the overlay memory. All the data in the 
overlay memory are deleted before the CAD result 
is written into the memory, tf no CAD result ad- 
dress is stored (nothing is stored in the CAD result 
ID), the same operation as the first embodiment is 
performed from application of a suitable CAD al- 
gorithm to the image data to writing the CAD result 
address into the table. 

According to the sixteenth embodiment, since 
it is possible to make a comparison diagnosis with 
reference to the reference image which has been 
read, thereby improving the diagnosis precision. 
When the CAD result display is desired, it is suffi- 
cient to touch only one button so that the operation 
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is simple. 

A seventeenth embodiment will be described. 
Though the above description, a suitable CAD al- 
gorithm is selected by the computer using the 

5 attribute data, in this embodiment, the doctor des- 
ignates the name of the CAD algorithm. Before 
reading of the image, the doctor selects one or 
more CAD algorithms as well as inputting the ex- 
amination ID. The names of the selected algorithms 

10 are arranged in the form of the table as shown in 
Fig. 43. When the image is input to the workstation, 
the CAD algorithms in the table are sequentially 
applied to the images. The other operation is the 
same as the first embodiment. 

15 According to the seventeenth embodiment, 

only a desired CAD result is selectively displayed 
and the display becomes simple. 

Additional advantages and modifications will be 
readily occur to those skilled in the art. Therefore, 

20 the present invention in its broader aspects is not 
limited to the specific details, representative de- 
vices, and illustrated examples shown and de- 
scribed herein. Accordingly, various modifications 
may be made without departing from the spirit or 

25 scope of the general inventive concept as defined 
by the appended claims and their equivalents. 

As has been described above, according to the 
present invention, there is provided a computer- 
aided diagnosis system for medical use, which 

30 outputs computer-aided diagnosis data with a high 
precision by a simple operation having no adverse 
effect on diagnosis made by doctors and a picture 
archiving communication system incorporating the 
computer-aided diagnosis system for medical use 
35 and having a high diagnosis precision. 

Claims 

1. A system for automatically analyzing a medical 
40 image using a predetermined computer-aided 

diagnosis algorithm, characterized by compris- 
ing: 

means for inputting a medical image and 
attribute data of the medical image; 

45 means for determining, based on the at- 

tribute data, whether or not the medical image 
is adapted to the predetermined computer-aid- 
ed diagnosis algorithm; 

means for analyzing the medical image 

so using the predetermined computer-aided di- 

agnosis algorithm in accordance with a result 
of a determination of said determining means; 
and 

means for displaying an analysis result of 
55 said analyzing means. 

2. A system according to claim 1, characterized 
by further comprising: 

18 
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a plurality of modalities including said in- 
put means; and 

a network for connecting said modalities 
and said analyzing means. 

5 

3. A system for automatically analyzing a medical 
image using a computer-aided diagnosis al- 
gorithm, characterized by comprising: 

means for inputting a medical image and 
attribute data of the medical image; io 

means for storing a plurality of computer- 
aided diagnosis algorithms; 

means for selecting, based on the attribute 
data, an optimum computer-aided diagnosis 
algorithm suitable for the medical image; 75 

means for analyzing the medical image 
using the optimum computer-aided diagnosis 
algorithm selected by said selecting means; 
and 

means for displaying an analysis result of 20 
said analyzing means. 

4. A system according to claim 3, characterized 
by further comprising: 

a plurality of modalities including said in- 25 
put means; and 

a network for connecting said modalities 
and said analyzing means. 

5. A system for automatically analyzing a medical 30 
image using a predetermined computer-aided 
diagnosis algorithm, characterized by compris- 
ing: 

means for inputting a plurality of medical 
images and attribute data of the medical im- 35 
ages; 

means for analyzing the medical images 
using the predetermined computer-aided di- 
agnosis algorithm; 

means for storing an analysis result of said 40 
analyzing means in association with the medi- 
cal images; and 

means for selectively reading out a de- 
sired medical image and a corresponding ana- 
lysis result and displaying the desired medical 45 
image and the corresponding analysis result 

6. A system according to claim 5, characterized 
by further comprising: 

a plurality of modalities including said in- 50 
put means; and 

a network for connecting said modalities 
and said analyzing means. 

7. A system according to claim 5, characterized 55 
by further comprising: 

means for storing a plurality of computer- 
aided diagnosis algorithms; and 



means for selecting, based on the attribute 
data, an optimum computer-aided diagnosis 
algorithm suitable for each of the medical im- 
ages. 

8. A system according to claim 5, characterized 
in that said reading and displaying means 
comprises: 

means for inputting retrieval data; and 
means for reading out an analysis result 
which is in accordance with the retrieval data. 

9. A system for automatically analyzing a medical 
image using a predetermined computer-aided 
diagnosis algorithm, characterized by compris- 
ing: 

means for storing a plurality of medical 
images and attribute data of the medical im- 
ages; 

means for selectively extracting one of first 
medical images which have been viewed and 
second medical images which have not been 
viewed based on the attribute data; 

means for analyzing the medical images 
extracted by said extracting means using the 
predetermined computer-aided diagnosis algo- 
rithm; and 

means for displaying an analysis result of 
said analyzing means. 

10. A system according to claim 9, characterized 
in that said storing means stores the medical 
images in association with the analysis result. 

11- A system according to claim 9, characterized 
in that said storing means stores an item of the 
attribute data denoting whether or not the 
medical image has been analyzed by said 
analyzing means. 

12. A system according to claim 11, characterized 
in that said extracting means extracts medical 
images which have been viewed but have not 
been analyzed by said analyzing means. 

13. A system for automatically analyzing a medial 
image using a predetermined computer-aided 
diagnosis algorithm, characterized by compris- 
ing: 

means for inputting a plurality of medial 
images and attribute data of the medical im- 
ages, the attribute data including an item of 
data denoting whether or not the medical im- 
age has been analyzed by said analyzing 
means and an item of data denoting whether 
or not the medical image has been viewed by 
a doctor; 

means for storing a plurality of computer- 
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aided diagnosis algorithms; 

means for analyzing medical images which 
are stored in said storing means, have not 
been examined by said analyzing means, and 
have been viewed by a doctor using an opti- 5 
mum computer-aided diagnosis algorithm se- 
lected based on the attribute data; 

means for storing an analysis result of said 
analyzing means in association with the medi- 
cal images; and 70 

means for selectively reading out a de- 
sired medical image and a corresponding ana- 
lysis result and displaying the desired medical 
image and the corresponding analysis result. 
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0 Computer-aided diagnosis system for medical use. 

© A picture archiving communication system for 
storing, transferring various digital image data in a 
single or a plurality of hospitals includes a modality 
<v> (10), a data base (12). a workstation (14) as a display 
unit and a network (16) for connecting these compo- 
_ nents. The modality (10) includes various diagnosis 
apparatuses for generating medical digital images, 
V" such as a film digitizer (18), an angiography appare- 
ls tus (20), a CT scanner (22), an MRI system (24), a 
00 nuclear medicine diagnosis apparatus (26), an ul- 
^ trasound diagnosis apparatus (28), and an electric 
q endoscope (30). An examination ordering system 
(32) is connected to the network (16). The work- 



station (14) outputs computer-aided diagnosis data 
obtained by analyzing medical image data by means 
of a computer. This computer-aided diagnosis data 
includes the location, the type, and the degree of 
abnormality. In order to alarm an abnormality, the 
workstation (14) displays a marker pointing the por- 
tion of the abnormal portion on the image, a text 
sentence representing the details of the abnormality. 
The computer-aided diagnosis data is obtained be- 
fore its output is requested. The computer-aided 
diagnosis data is stored in a semiconductor memory 
(86) until its output is requested. 
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